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The purpose of this study is the substantiation of 
the use of selective cognitive and affective measures for effective 
identification of degree and level of academic disadvantagement of 
Higher Education Opportunity Program (HEOP) stu'dents in New York 
State. This was accomplished by investigating the relationship 
between academic efficiency (e.g., selective cognitive and 
nonrcognitive measures) and persistence (e.xf,, time spent in 
college); (b) establishing base rates of learner behaviors for each 
grade level for selected predictor and criterion measures; and^ (c) 
investigating the relationship between academic efficiency and 
academic success criteria. The design' of the study is based on two 
premises: that academic efficiency is related to persistence^ and 
that it is also related to success. Predictors used are academic 
efficiency measures and biographic data^ while criteria used are 
persistence measures and academic success measures. Major results and 
conclusions based are: (1) upper classmen perfarm more efficiently 
than lower classmen on the measures selected for inclusion in the 
study^ leading to the acceptance that academic efficiency is related 
to persistence; (2) positive but weak relationships exist between 
individual academic efficiency measures; (3) relationships between 
persistence and sex, type of high school diploma, and ethnicity do 
not exist. (Author/AM) 



Documents acquired by ERIC include many informal unpublished materials not available from other sources. ERIC makes every 
effort to obtain the best copy available. Nevertheless, items of marginal reproducibility are often encountered and this affects the 
'ii the microfiche and hardcopy reproductions ERIC makes available via the ERIC Document Reproduction Service (EDRS), 
"not responsible for the quality of the original document. Reproductions supplied by EDRS are the best that can be made from 
iial. • . ' 



ERJC. 



JnD Research 
mUamsvtlle, New York 



us OEPARTMENT OF MEALTM 
gOUCATlON & WELFARE 
NATIONAL INSTITUTE OF 
EDUCATION 

Jm>S DOCUMtNT HAS BEEN PfcPRO 
ftuCED FXACTcY AS, RECEIVED fROM 
THE PERSON OR ORGANiZATiON ORiOm 
ATiNO »T POiN^SOF ^'tew OR OPINIONS 
STATED DO NOT NECESSARhY f^fPRE 
SENT 0*^f JCIAC NATiONAt INJTtTgTE O^ 
EDUCATION POSjT^On or POl'CY 



VALIDATION OF SPECIFIC TESTS 
for " 

DIAGNOSTIC AND PRESCRIPTIVE PURPOSES 
with 

POTENTIAL HEOP STUDENTS 



FiNAL REPORT 



By 

Judith G. Wolf, Ph.D 
David Sylves, M.S, Ed, 



Project Director: Judith G. Wolf, Ph,D . 



in cooperation with 

Rosary Hill College 
Snyder, New York 

and the 

Bureau of Higher Educational Opportunity Program 
New York State Department of Education 



TABLE OF CONTENTS 



LIST OF TABLES 
L INTRODUCTION 
II. STATEMENT of' PROBLEM 

III. DESIGN AND HYPOTHESES 

IV. ^lETHOD 

A. Sample 

B. Variables 

1. Predictors 

a) Academic Efficiency Measures 

b) Biographic Data 

2. Criteria 

a) Persistence Measures 

b) Academic Success Measures 

C. Procedure 

D. Method of Analysis 

V. RESULTS AND DISCUSSION 

# 

VI. CONCLUSIONS 

VII. FOOTNOTES 



APPENDICES 



A. TEST' DESCRIPTION 

B. TESTING PROCEDURE TRAINING GUIDE 

C. MAJOR FIELDS OF STUDY 

PART I: CLASSIFICATION 
PART II:, DATA DESCRIPTION 



LIST OF TABLES 



TABLE 



PAGE 



Pne 
Two 
Three 

Four 
Five 

Six 

Seven 

Eight 

Nine 

Ten 
Eleven 

Twelve 
Thirteen 

Fourteen 

Fifteen 

Sixteen 



Sample Size by School and Grade Level 
Selected Biographic Information by Grade Level 

MANOVA Results: Subaroup Means, Rank of 
Means and Standard Deviations for 
Test Scores and GPA 

MANOVA Results: General Analysis 

Data Description Results: Subgroup Sample 
Sizes, Means, Rank of Means, Standard 
Deviations and Range of Test Scores 
and GPA 

Total Group Means, Standard Deviations and 
Sample Sizes for Persistence and Academic 
Efficiency Variables - , 

Correlations Between Persistence and Academic 
Efficiency Variables With Sample Sizes 

Total Group Means, Standard Deviations and 
Sample Sizes for Selected Biographic Data 

Correlations Between Persistence and Selected 
Biographic Variables With Sample Sizes 

Data Description of Additional Variables 

Correlations Between Academic Efficiency, 

Selected Biographic, and Academic Success 
Variables With Sample SizQS . 

Results of Step-Wise Multiple Regression Analysis 

Results of Multiple Correlation Analysis Between 
Predictor Sets and GPAZ 

Intercorrelations^ Between Predictor Sets 
With Sample Sizes 

Intercorrelations Within Predictor Set One 
With Sample Sizes 

Intercorrelations Within Predictor Set Two 
With Sample Sizes 



11 
12 
22 

23 
24 



27 

28 

32 

33 

35 
36 

39 
41 

43 

47 

48 



ERJC 



LIST OF TABLES continued 



TABLE 

Seventeen 
Eighteen 

Nineteen 



Twenty 



Twenty-One 



Intercorrelations Within the Criterion Set 
With Sample Sizes 

Data Description for Two Groups: Strong 
Supportive Services and Minimal 
Supportive Services 

Correlations Between Kours Completed and 
Academic Performance* Measures for Two 
Groups: Strong Supportive Services vrs 
Minimal Supportive Services With 
Sample Sizes 

Means and Standard Deviations for 12 

Academic Efficiency Measures for Mid-Year 
Freshmen' and\New Admittants 

MANOVA Results: ^General Analysis for 

Mid- Year Freshmen and New Admittants 



PAGE 
50 
55 

56 



59 



60 



ERIC 



/// 



i; INTRODUCTION ^ ' \ ' 

the last tea years, noteworthy efforts have been made to in. roase 
the accessibiiicy of higher education* Such efforts are exemplified by the 
advent of open admissions policies and increased availability of state and 
federal graats-in-aid and low interest or deferred payment loans. As a 
result of these efforts, students with, varied backgrounds^ and experiences 
are now being admitted to colleges and universities. The establishment of 
a large number of Educational Opportunity Programs combines extension of 
regular admission criteria and the availability of financial aid maki-ng -it 
possible for students who are disadvantaged both financially and academ- 
ically to receive the benefit of a college education* 

The Iv^w York State Higher Education Opportunity Program (HEOP) states 
that its primary objective "is to serve as a vehicle through which a broad 

range of services>are made available to young people, who, because of 

•\ 

' ^ '* 

economic and educational deprivation, would otherwise be unable to attend 

a post--secoadary Institution according to traditional admission require- 
ments.'* (1) On the basis of this statement of purpose and the definition 
of the target population contained within the statement, it would seem 
that preliniinary identification of those students who qualify academically 
for HEOP programs would be a relatively simple procedure. Theoretically, 
it should be possible to identify these students through the use of the 
same admissions criteria used. for regular admissions students; the 
difference being that the cut off or selection point would function as the 
upper rather than the lower limit. In other words, if regular admission 
students are defined as those students who score above a certain point on 
a number of selection measures, then it would follow that students scoring 
below this delineation would be definiad as special admission candidates. 
The remaining task would then be to select for admission those special 

* G 
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admission candidates who can be identified as having the potential to 

. benefit from a college education. 

In spite of the fact that selection of disadvantaged students seems 

theoretically^si^le, in actuality it is complex* The co#lexity steins 

from controversy over measures commonly used to select regular admissions 

students and to discern academic potential* There has been a perdurant 

debate as to whether .these standard predictors can be utilized with 

minority group students validly and without bias* " , 

If valid prediction and lack of bias are the criteria for test 

selection, a review of the literature for the purpose of identifying 

usable non-cognitive and cognitive measures is somewhat illustrative. 

Only two non-cognitive instruments came. close to empirically satisfying 

these criteria. These two instruments, the College Academic Performance 

Biographical Inventory, and the Survey of Study Habits and Attitudes, 

were used in this study. The fact that the major evidence pertaining 

to cognitive measures is contradictory, renders a search of the literature 

for the purpose of identifying usable cognitive measures almost worthless. 

A review of the literature does, howeve',, exemplify the basis for 

controversies regarding the use of many identified measures with a group of 

disadvantaged students. The unresi^lVed status of these issues may have 

precipitated recent decisions to admlt^isadvantaged students to colleges 

on the basis of alternative admissions criteria. Stanley (2) has noted 

this trend and has presented objections which are convincing: 
♦ 

"Substituting principals', and teachers' ratings of probable 
college success for test scores and high school grades appears to 
me an unfortunate step backward Into the subjectivity, invalidity, 
and social class biases of the 19th ceritruy. It would seem more 
sensible to predict the criterion for each applicant , from all 
available predictors and then, if desired, to set up predictive 
lists separately for disadvantaged arid non-di«advantaged. Those 
disadvantaged applicants who seem on the basis of all evidence 
most promising, academically and otherwise, can be accepted, 
offered financial aid, and where needed, given massive educational 



remediation and tutoring. ' ^ 

I would urge a, reversal oi the current trend. The' more 
disadvantaged a college applicant seems to be sbcioeconomically, 
the more objective information one needs" about him." (3) . 

If the argument propounded by Stanley can be accepted as providing 

sufficient rationale f6r cogent utilization of test*scores, perhaps it 

will fee possible to reverse the trend toward their non-use and dispel 

the climate of mistrust. The most viable approach appears ^to be the, 

utilization of instruments which are relevant to and appropriate for the 

specific target population. In order to fulfill these requirements, those 

instruments should simultaneously provide both valid prediction of future 

academic ^success and effective identification of learner needs. This 

duality would facilitate selection of appropriate students for entrance 

into a higher education situation, and would aid. curriculum, personnel in 

providing necessary educational experience to maximize utilization of 

student potential. 
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II. STATEMENT OF PROBLEM * . 

The purpose of this study is to substantiate the use of selected 

> 

cognitive and affective measures for effective identification of degree 

19 

and level of acade;nic disadvantagemerit of Higher Education Opportunity 
Program students 'in New York State. 
*' * ^Thesc^ purposes will be accomplished by: 

\k. Investigating the relationship between academic efficiency^ 
(e*g* selected cognitive and non-cognitive measures) and 
persistence (e.g* time spent in<college); 

B. Establisl^ing base 'rates of learner behaviors for each grade 

level for selected; predictor and criterion measures; and, 

C. Investigating tMe relationship between academic efficiency 

and academic^ success (e.g. GPA) criteria. 



-J ' 



III. DESIGN AND HYPOTHESES « - ' ' * 

The most favorable method for accomplishing the' purposes outained the 
Statement of Problem would be through the of a longitudinal design. 
This, however, would entail four years of,, study. The urgency which acconpanies 
the need to identify useful measures precluded the use of a longitudinai 
design. As a result, with cognition of its limitations, an alteniate method 
requiring only one half year of study and utilizing special admission^ 
students at all four grade levels was designed and completed. 

The design of the present study was based on the following two premises: 

A. With a group predeifined as academically disadvantaged, academic 
efficiency, as demonstrated by cognitive and affective -test 
scores, is related to persistence; and, 

B. With a group predefined as academically disadvantaged, academic 
efficiency is related to academic success. . 

■ "• \ ... 

Premise A ♦ ' 

Academic efficiency is related to persistence. 

> 

Since, academic efficiency is an original term, further clarification 
is appropriate. Academic. efficiency can be defined as the degree to which 
an individual is able to perform educationally related tasks such as 
reading, writing, and mathematics, and to exhibit educationally related 
behaviors such as motivation for studying. Operationally, academic 
efficiency is defined as the performance levels of skill related and non- 
cognitive behaviors. Specifically, in this study, an operational defin- 
<ition of academic efficiency is provided by scores on the four predictot 
measures selected for inclusion in the study. 

Persistence refers to time spent in college. Operationally, 
persistence can be defined as the grade level attained by a given student. . 
Specifically, in this scudy, one operational definition of persistence 
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is provided by the number of course hours completed by a student. 

<v # 
second operational definition is provided by the dicoComous". Hit/Miss 

variable. A score on this variable is based on^^a. comparison between 
date' of entry and expected "gr&de level. ^ . ; 

In considering premise A, it woul^ not seem incorrect to assume 
' that the sample of disadvantaged students becomes more selective (or 
more academically efficient) with each succeeding grade level. Of course 
not all students drop out for academic reasons, but it would seem that 
this reason wouJd take -precedence over roost others. Therefore, ^if 
premise A** is true, t\ie following hypotheses result: 

1. Academic efficiency means will be higher for each succeeding 
* grade level. In other words. Sophomores should have "^hlgherj 

scores on selected co^itivc and affective measures than 
Freshmen, Juniors should have higher scores than Sophomores, . 
and Seniors should have the highest scores^ In effect, the 
findings relating to this hypothesis will not only substan- 
tiate 'the 'premise \>xxt will establish base rates of learner 
behaviors for each grade level; - 

2. There will be significant relationships between measures of 
persistence and academic efficiency scores. This will provide 
an indication of- those measures on which persisters excel, 
which in txxtn will suggest which measures more successfully 

' dedote potential; and 

3. There will te significant relationships beU'een measures of » 

* • » 

persistence and selected biographic data. An investigation of 
the relationship between persistence an4^ selected biographic 
will complete this aspect of the model by describing 
. characteristics of persisters. 

\ > . • 

il 



Premise B ' ' ' 

Academic efficiency is related to academic sufcc'^si. 
Academic success is^a difficult criterion to measure due to the lack 
of a standard for the assignment of .grades among schools- Nevertheless, 
grade point average has beefj utilized, as the main criterion variable 
be'taude -it is the success criterion used by all colleges* In those 
analyses which utilize correlational procedures > this major weakness has 
*been' compensated for by standardizing grade point average by school. 
Consequently, ^tjie hypotheses whicli result from premise two have been 
tested using either grade point average or g:;ade point average as a 
within school Z scores. Therefore, if premise B is. true, the 
following hypotheses result: 

'..-4.^ There will be significant relationships between academic 

efficiency 'scores and measures of acadejaic success. This will 
• provide an indication, of which test best predicts academic 
success; and * 
. • 5. There will be significant relationships between selected 

biographic^ata and^ measures of academic success. This will 
provide an indication of those characteristics which best 
predict academic success. 

To complete the model, several additional hypotheses are necessary: 
6. There will be zero correlations between measures of academic 
efficiency and selected biographic data. .An investigation Of. 
relationships within the predictor set will determine th^ degree 
* to which the academic -measures selected fpr inclusion in this 

' study are free from bt'as; 
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* • 

7. There will be significant relationships between measures of 
academic 'Success and measures of persistence. This investi- 
gation of relationships within the criterion set will answer 
the question, "Do persisters succeed according to predetermined 
standards of success?"; and ' ^ 

8. Grade point average means will be- higher for each succeeding 
grade level. Findings relating to this hypothesis will con- 
tribute to the establishment of base rates of learner behaviors 
for each grade leve^. More significantly, these findings '^'will 
contribute to an understanding of the college effect by 

' * answe^g^ the question, "Do students tend to become more 

successful academically with time spent in college?" 
Finally, since" the p^sent study was conducted at mid-year, it fcould 
be argued that mid-year Freshmen are not Representative of entering 
Freshmen. In "effect, this does not negate either of the premises upon 

which the study is based. It could' however , have an effect on the ^ 

> 

e-8ta"blishment of baserates of Freshmen behavior, especially if one 
semester of higher education experience does significantly altar test 
scores; To test this question, the following hypothesis was included 

in the study: - • 

9. There will be no significant differences between academic 
■efficiency scores of mid-year Freshmen and new admittants. 

-As an adjunct to the main research, actual or expectdd- major field" 
•<if study as Indicated by the students were classified into ifoad areas of 
study and analyzed through the use of data description techniques. The 

• * 

purpose of this analysis was to add to the existing knowledge base 
regarding the target population." Since this' variable is categorical 'and 
usea-a nominal scale, the analysis was treated as a separate study. 



9 



IV. METHOD 
A. Sample 

The sample consisted of academically- and financially disadvantaged 
Students enrolled in selected four year institutions in the State of New 
York. In order to insure a representative sample of the opportunity 
program effort in the State, institutions which represent the following 
school types were inclOded in the study: large., small, urban, suburban,^ 
religious and secular.. Commuter and residential students attend all schools. 

Specifically, the following schools participated in the study: 

1. Rosary Hill College 
Snyder, New York 

Program Director : jn^^fister Mary Francis Welsh 
Director of Counseling: Dr. Thomas Miller 

2. LeMoyne College 
Syracuse, New York 

Program Director: Carl Thomas 

3* Utica College 
Utica, New York 

Program Directors: Paul Shelton 
> Barbara Bell 

4» Canisius College , 
Buffalo, New York 

Program Director: Leroy Mitchell 

5. State University College at Fredonia 
Fredonia, N^w York 

Program Director: Jeffrey J. Wallace^. 

6. State University College at Buffalo 
Buffalo, New York 

Program Director: Dr. Isaiah Reid 
cAssociate Chief Counselor: Robert L. Palmer 

7* Long Island University 
Brooklyn, New York 

Program Director: P*rof6ssor Alphonso Haynes • 
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Early in the Spring- semester, selected measures vera admJ.nistercd 
to 1,074 Freshmen, Sophomore, Junior, Senior and newly admitted Freshiiian 
students at the seven institutions.'^ Of ^his number, all Freshmen, 
Sophomore, Junior and Senior students for whom grade point average and 
number of hours completed were available were retained for inclusion in 
the study. Utilization of a special feature in the conq)uter program' 
used for the correlational analyses made it possible to include all 
subjects with data on any given variable pair. This resulted in differ- 
ent sample sizes within the correlation matrix dependent upon those 
variables which were available for a given student. The sample sizes 

ranged from 962 to 857» 

Of the 962 Freshmen, Sophomore, Junior and Senior students retained 
in the study, 417 were males, 545 were females. Ages ranged from 16 to 
58 years of age with the average age being 23.34 years. 

Those newly admitted Freshmen for whom complete data was available 
on all four tests were ^also retained for inclusion in the study. Of the 
101 new admittants tested, 82 were retained. Forty-six were males, 36 
were females, and the average age was 23.13 years with the age range 
being 17 to 44 years. 

Table One (page 11) presents a quantitative breakdown of the sample 
sizes by school and grade level. 

Table Two (page 12) presents selected biographic information by 
grade^ level. More definitions of the variables have been presented in 
the next section. ' 



ERiC 



lb 



c 



CO 



OQ 



00 



11 



o 



c 



g 

'5 

~5 



f-1 CO rH 



ON 

I "-H 



0) 



o t/> 



o 



CM 



CM 



UJ 

> 

UJ 



c 

si 



o 

CM 



ON 



o 

CM 



00 

CO 



00 
00 
CM 



CO 



CO 



O 
< 

o 



O <t3 



O 



CM 



O 



00 o 



CM 
vO 



< 



O 
O 
X 

o 

CO 

> 

UJ 

N 
(/> 

UJ 
-J 
Ql 

S5 



^ >» 52 



2 ^ 5 p 



CM 



in 



CM 



CO 



»n 



CO 



00- 



CO 



CO 



00 



VO 

m 



VO 



CO 



VO 



in 



in 



o 



o 
o 

JO 



o 
cc 



c 
> 
o 

0) 



c 

<3' 



c 
o 

X3 

o 

O 

D 
CO 



3 

o 



it] 



12 



TABLE TWO 

SELECTED BIOGRAPHIC INFORMATION BY GRADE LEVEL 



Variable Statistic 



New Admits Freshmen Sophomores . Juniors 



SEX 



AGE 



N Total 
N Males 
N Females 

N Total 

Mean 
SD 

Range 

N Total 
Mean 



HIGH . 
SCHOOL SD 
AVERAGE 

Range 



82 

46 

36 

82 

2^.13 
5.66 
17 to 44 

56 

75.18 
6 . 4'9 
61 to 91 

79 



N T9tal 

HIGH ^ . , 

SCHOOL ^ Equivalency 23 

CODE 

N Averages 56 



N Total 

ETHNICITY ^'^"^^ 
N Other 

N White 

N Total 
N HEOP 
N EOF 



SCHOOL 
TYPE 



82 
58 
4 
20 

82 
9 
73 



394 
172 
222 

393 
21.22 
5.14 
17 to 48 

341 
76.20 
5.97 
60 to 93 

384 . 
43 
341 

394 
271 

26 

97 

^ 394 
68 
326 



276 
126 
150 

276 
23.12 
5.90 
16 to 58 

240 
76.35 
6.17 
60 to 91 
s 

264 
24 
240 

276 
191 

12 

73 

276 
51 
225 



190 
78 
112 

189 
25.69 
6.94 
19 to 56 

159 
77.67 
6.22 
60 to 91 

177 
18 
159 

190 
138 

10 

42 

190 
34 
156 



Seniors 

102 

41 
61 

102 ' 
27.75 
7.95 
20 to 57 

87 " 
77.66 
5.40 

65 to 88 

97 
10 
87 

102 
77 
5 
20 

102. 
15 
. 87 
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B. Variables 

1. Predictors 

a) Academic Efficiency Measures 

Following the direction provided in a review of the liter- 
ature and based on the oginion of expert judges (A) , the following 
four instruments were selected- for inclusion in the study: 

1. College Academic Performance Biographical Inventory (CAP) , 
Greensboro, N.C.: Prediction Press, 1969; , , 

2. Survey of Study Habits and Attitudes (SSHA) Form 
New York, N.Y. : The Psychological Corp. 1967. 

3. Stanford Test of Academic Skills (T ASK) Level I^-'A. 
New York, N.Y. : Harcourt Brace Jovanovich, Inc., 19/2. 

A. Four out of eight sections of, the: 

Comparative Guidance and Placeme nt Program (CGP) of the 
College Entrance Examination Board, 1972. 

A detailed description of eacH of the four tests may be found 
In Appendix A. 

Specifically, utilization of^'the above Instruments produced 
scores on the following: fifteen measures of academic efficiency: (5) 

1. CAP - College Academic Performance Scale 

2. SSHA - Survey of Study Habits and Attitudes: 

' DA (delay avoidance) 

3. WM (work methods) - ^ ' 

4. TA (teacher approval) 

5. EA (education acceptance) 

6. SH (study habits) 

7. SA (study attitudes) 

8. SO (study orientation) 

9. TASK - Stanford Test of Academic Skills: 

Reading 

10. English 

11. Mathematics ■ 

12. CGP - Comparative Guidance & Placement: 

Read In p, 

13. Sentenceij 

14. Mathemati.es 
15 • Year 2000 



ERLC 



16 



14 



b) Biographic Data 

fhe following biographic variables were included in the study: 

1. Sex 

Males were coded as (1); females as (2). 

2. Age 

Since the tests were administered during a two month 
period from the end of January to the end of March, a- cut off point 
of March 1st, which was midway through the testing period, was*^ 
utilized as the basis for determining age. 

3. Grade Level-* 

Since each school required the completion of a different 
number of hours for advancement to a subsequent grade level, the 
following code was used to determine grade level: 

Freshman 0 to 29 hours completed 

Sophomore 30 to 59 hours completed 

Junior 60 to 89 hours completed 

Senior 90 and above hours completed 

4. High School Average (H^S.AV.) 

5. High School Code (U.S. Code) 

This variable was included becaus^e. a number of students 
had taken the high school equivalency exam and did not have high 
school averages available. For this variable, therefore, those 
students with high school equivalency indicated on their records 
were coded as (1) • Students who had high school averages were 
coded as (2). ' . ; 
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•6. Ethnicity (El) 

a) Three ethnicity codes were used in the study. Blacks 
were coded as (1) , Whites were coded as (3) , and Others were 
coded as (2). The latter group consisted mainly of students with 

Spanish surnames. 

b) In order t<^ verify correlations which utilized the 
above codes, two additional ethnicity variables were created for 
use in seyeral of the analyses. The first of these variables 

. (E2) was coded as follows: 

-1 - Whites, 0 - Others, 1 - Blacks. 

The second variable (E3) was coded in the following 

manner: 

-1 » Whites, 0 - Blacks, 1 - Others. 
7« Type of School 

Students were divided into two groups depending on 
"whether they participated in an HEOP (coded as (1)) program or ^ 
an EOF program (coded as (2)). 
8. Major Field of Study . 

Major fields of study were classified into seven 
broad categories. The categories and specific courses of study 
within each category are presented in Appendix C, Part I. 

2. Criteria 

a) Persistence Measures 
1. Hours Completed 

Courses which were completed successfully with a grade 
of A,B,C or D were included In the computation of this measure. 
For transfer students, hours completed at the present institution 
plus hours accepted for transfer were ut;llized. 
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2. Hit/Miss 

'This variable vJWas included for the purpose of 
investigating relationships between predictor and criterion 
variables, and length of time from date of college entry to the 
present, Scores>^vere calculated in the following manner^ 

Expected number of completed hours and expected grade 
level were established for specific entry dates* The chart 
presented below was then completed. » 



Expected 
Expected Number of 

Entry Date Grade Level Hours Completed 



Fall ■ 1973 


1 




15 


Summer 1973 


1 




18 


Sprijig 1973 


2 


30 


- 59 


Fall 1972 


,2 


30 


- 59 


Slimmer 1972 


2 


30 


- 59 


Spring 1972 


3 


60 


- 89 


Fall 1971 


3 


60 


- 89 


Summer 1971 


3 


60 


- 89 


Spring 1971 


4 




90+ '■ 


Fall 1970 


4 




90+ , 


Summer 1970 


4 




90+ 



The following data was then obtained for each student: 

(a) the date of his first registration at 

•any college (entry date); 

(b) the nutaber of hours he had completed 

successfully; and 

(c) his grade level based on (b) ♦ _ / 

Based^^qn^his actual entry date, it was ascertained 
whether or not he had attained the expected number of completed 
hours, and therefore, the expected grade levels If he was at or 

\ 

above grade level, he was classified as a Hit and given a score 
of 2. If he was below grade level, hennas classified as a Miss 
and given a scor'e of 1, " ^ ^ 
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3. A discrepancy measure consisting of number of hours for 
which a student had registered minus number of hours completed 
was proposed for use in this study. However, it was Impossible 
to obtain the information necessary to complete this variable due 
to the fact that most participating colleges! do not have records 
of^'courses dropped. In addition, incompletes could not be 
obtained'^ since one college transforms I' s into F's shortly after 
the end of each semester and, therefore, does not retain records 
of I's. 

b) Academic Success Measures 

1. Grade Point Average (GPA) cumulative total 

Since different types of grades were used to calculate 
GPA at some of the participating institutions, it was necessary 
to standardize the computation of GPA. This was accomplished by 
including only grades of A,B,C,D and F in the cumulative total. 
Grades of I (incomplete) and W (withdrew) were not included. 

In addition, if a student had transferred from another 
institution, the 'GPA used for that student included only those 
grades which had been received at his present institution. 
This was necessary because it was not possible, in most cases, 
to obtain transfer records containing GPA. 

<^ 2. Grade Point Average Transformed Z Score (GPAZ) 

To compensate for the lack of a standard for the assign- 
ment of grades among the participating Institutions, within school 
Z scores were calculated for GPA. This score was used in some of 
the analyses to control for a school effect. 
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C. Procedure 

In order to insure the highest degree of cooperation, suggestions from 
program directors at- all participating institutions were incorporated into 
the procedure. Consequently, the following procedures were utilized: 

A battery of tests "consisting of the four tests described above were 
adaiinistered to all HEOP or EOP students at the participating institutions 
during Spting semester, 1974. One day, selected by the college program, 
director and occurring as early as possible in the semester, was designated 
as a testing day at each institution. All four tests were administered 
bo- each group of students on the designated date. When the student 
enrollment was too iarge to accomodate all students on one day, several 
days were designated. The important procedural factor was t^at a given . 
•student took all tests on one day. Two tests were administered during 
the morning session. This session took approximately four hours. 
Following a lunch break, the other two tests were administered. This 
session took approximately three hours. In addition to the designated 
testing day, makeups were given at six of the. colleges. 

The "tests were adminisf.ered by appropriate program personnel at two. 
colleges (Rosary Hill and SUC Buffalo) and by the project test administrator 
at the other five' colleges. All project and program personnel involved in 
test administration were trained in'*the methods of teot admintptration by 
the researchers. The testing procedure training guide may be found in 
Appendix B. . ' 

Testing dates were as follows: 

Rosary Hill 2/28/74 

LeMoyne 2/ 5/ 7-4 

Utica 3/2/74 .. . 

Canisius 1/31/74 and 3/27/74 

SUC Fredonia 2/12/74 and 2/14/74 

SUC Buffalo 2/ 2/74, 2/9/74; 2/23/74, 3/2/74 and 3/3/74 

L.I.U. 3/23/74 
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Academic performance criteria from first £.-mestui: (January) transcripts, 
and biographic data .were obtained for each student. This data was either^ 
supplied by Admissions and Records Departments or coii.ected by program 
directors and project personnel. Obviously, college academic siicceso 
measures for January admittants were not available. 

D. f(/lethocl of Analysis 

The data was analyzed through the use of multivariate analysis of 

V 

variance and multivariate correlation^ procedures. 

« 

Specifically, the multivariate analysis of variance computer 
program, NYBMUL, (6) was used to test for differences between means. This 

program requires that each subject have complete d^ta on all variables 

• > \ 

used in a given analysis. / ^ • , 

A Ffultiple Analysis Program System for Behavioral Science Research, ♦ 
MAPS, (7) was used for all other analyses." This system was. chosen because 
it, has a special feature. which make^ it possible to utilize data for a ^ 
given subject "providing that complete data is present for any specific 
variable pair. The following. MAPS program!^ were selected for data analyses: 
^ < 

DATADES - Data Description ' ^ ' 

This program computes descriptive statistics for all variables. 
It is conpaonly used to check the accuracy of data and 0 provide 
descriptive information about ,the variables to aid in planning 
futther analyses: (8) 

RMATRIX T Correlation Matrix ' / • • . 

This program provides information about intercorrelation'? of all 
variables by computing a correlation matrir in *+iich each variable is 
correlated with each other variable. (9) * , ^ * 

STEPREG -Step-Wise Multiple Regression Analysis 

"This program competes a .correlation matrix> then computes multiple 
correlations between selected independent variables and^a designated 
dependent variable. Independent variables may be forced into regretjsion 
in any desired order or may be selected in a step-wise fashion to 
maximize the multiple correlation at. each step." (10) "Step-wise , 
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regression may be used to develop an equation for the predictioa of 
some variable of interest..*. It ma^rtalso be used to study the relation 
ships aittbng variables with other variables statistically controlled, *by 
using the<5^cing option to force the control variables into 
regression first.** (11) 

MULTR - Multiple Correlation Analysis . , 

"This program uses the matrix file for input and computes the 
multiple correlation and associated statistics between several 
predictor variables and a criterion variable. The predictors may 
be divided into* two sets in which . ca8e*E?S<^. regression analysis is 
done separately for each set alo.ne and for both sets combined. 
This^allows a partitioning of .the. criterion variance intfo parts 
uniquely predictable from each set and* a part jointly associated 
with both sets/* (12) 

Both STEPREG and MULTR supply associated statistics which include an 
F test of the significance of the multiple correlation. , * 



• .21 • 

V. RESULTS AND DISCUSSION ' ' ' ' . 

Premise A : Academic effi-ciency is relisted to persistence. - 

Hypothesis !• Academic efficiency means will be higher for 
each succeeding grade level. 

Two methods were utilized as a test of this hypothesis. The first 
method, a one factor, four level multivariate, analysis of variance 
(MANOVA) , utilized NYBMUI, to test for 'signif icant differences among the 
four grade level groups on 12 academic efficiency predictor variables 
and one academic success criterion variable. Although the academic 
* success criterion variable is discussed under a^ different premise, it 
waa Included in the present analysis because GPA is part of each 
subject's vector of scores. To separate one measure from a- vector of 
measures would be^rtificial and may give spurious results. The second 
method, a MAPS data description, allowed for the examination of group 
^ means utilizing the maximum sample size. 

Tables Three and Four present results from the multivariate i^ialysis 
of variance (MANOVA). Table Three (page 22) reports the means, rank of • 
the mean by grade level, and the standard' deviations for the four groups J 
on the 13 variables. 



Multivariate and univariate analysis of variant:e results are 



presented io Table Four (page 23) • 

Table Five (page 24) presents results from the data description. 

\ 

This table which can be'- co^npared to Table Thr6e reports sample sizes, 
means, rank of the mean by grade level, standard deviations, and range 
for the four groups on the 13 variables. 
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Examination of Table Four indicates that the multivarifite F cf» 3.43 
is significant at the .0001 level. This means that ther^^^is a difference 
between grade level means. This rcfsult allows, us "to examine the 
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univariate F's in Table Four to ascertain which variables are the most 
significant on an individual basis. It. can be seen that GPA is 
significant' and all tests, with the exception of SSHA DA (delay avoidance) 
and TA (teacher approval) are significant. The most significant are: 
(1) GPA; (2) CGP Reading; (3) CGP Math; (A) .CGP Sentences; and 
(5) TASK Reading. 

The existence of significant differences between grade levels is « 
necessary but insufficient test of hypothesis 1. In conjunction with the 
tests for significance, it is also necessary to examine the directions of 
the means. Examination of Tables Three and Five indicates that although 
the rank of the Seniors is somewhat erratic, in general upper classmen 
perform better than lower classmen. This lends support to the premise 
that academic efficiency is related to persistence. 

One additional point related to this hypothesis deserves mention. 
Inspection of the group means for the College Academic Performance Scale 
(CAP) reveals a general increase in means from Freshmen to Senior year. 
Since the CAP scale contains questions relating to biographic and 
psychological information, it is interesting to* speculate on possible 
causes for this increase. Perhaps the college experience contributes 
breadth to one's background and strength to one's self concept, causing 

members of each class to answer certain questions differently. 

! 

Hypothesis 2. There will be significant relationships between 

measures of persistence and academic efficiency scores 

The purpose of this asbect of the investigation was to identify those 

measures on which persisterii excel. To test hypothesis 2, correlation 

analyses using the MAPS system were performed on the total sample. The 

I 

total sample was formed by pooling the four grade levels and utilizing 
the maximum sample sizes within each grade level. 

- : 30 ' ' 
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Table Six (page 27) presents the Sample sizes, means, and 
standard deviations of the 2 persistence measures (hours completed and 
Hit/Miss) and the 12 academic efficiency measures for the total sample. 

The intercorrelations (r) between the two sets of variables are 
presented in Table ^even (page 28). The sample size for each individual 
correlation is presented in parentheses beneath the correlation coefficient. 

The test for significance of a correlation coefficient asks the 
question, "is che r significantly different from zero?" With an N of 500, 
the coefficient must be .088 or higher in order to be significantly 
different from zero at the .05 level. It must be .115 or higher to reach 
the .01 level of significance. 

Examination of Table Seven indicates that most of the correlations 
are significant at the .01 level. In addition, ail correlations are 
positive. This suggests the existence of some structure, within the 
matrix. However, the fact that the highest coefficient is only .20 
i^iplies that the structure is limited. One explanation for this might 
be the erratic pattern of the Seniors. The results of the MANOVA 
analysis and the data description presented previously, (Tables Four and 
Five respectively), support this explanation. Since by definition, 
Seniors have completed the. most hours, it would be necessary for them 
to excel on most tests in order to achieve high correlation coefficients. 

As a concurrent explanation, the lov correlations may have resulted 
from the existence of a wide spread of test scores within each grade 
level accompanied by .an overlap of scores between grade levels. Of 
course, the existence of excessive overlap would have resulted in failure 
to reject the null hypotheses that there is no difference between grade 
level means on academic efficiency measures. Since the null hypotheses 
was rejected, it is apparent' that extreme overlap does not exist. The 

31 



* 



27 



TABLE S\)<. 

TOTAL GROUP MEANS, STANDARD DEVIATIONS AND SAMPLE SI) 
FOR PERSISTENCE AND ACADEMIC EFFICIENCY VARIABLES 



Variable 


Mean 


Sd 


N 


Hours Completed 


A2.92 


32.34 


962 


Hit/Miss 


. 1.39 ' 


.49 


962 


CAP 


102.97 


12.33 


852 


CGP Reading 


48.72 


9.76 


919 


Sentences 


47.60 


8.63 


919 


Math 


■ 50.11 


8.26 


908 


Year 2000 


46.52 


11.15 


916 


TASK Reading 


52.17 


12.96 


940 


English 


49.20 


10.29 


941 


Math 


26.34 


9.07 


oo-» 


SSHA DA 


23.66 


9 . 90 


892 


WM • 


25.76 


9. -77 


892 


TA 


23.36 


9.04 


892 


EA 


25.42 


8.46 


892 



3 



TABLE SEVEN 



CORRELATIONS BETWEEN PERSISTENCE AND 
ACADEMIC EFFICIENCY VARIABLES 

, WITH SAMPLE SIZES 
Variable . Hours Completed Hit/Miss 



CAP 

CGP Reading 

Sentences 
Math 



TASK ' Reading 



WM 

TA 
EA 



.12** .13** 

(852) (852) 

.20** .16** 

(919) (919) 

.18** .16** 

(919) (919) 

.19** .14** 

(908) (908) 



.11* .13** 
Year 2000 . (915) (916) 



.17** .14** 
(940) (940) 



- .. ■ 12** .13** 

English ^-J^j 

.08 .i3** 

Math (937) (937) 

.08 .14** 

SSHA DA (892) (892) 



.11* .13** 

(892) (892) 

.03 .04 

(892) (892) 

.11* .14** 

(892) (892) 

» p<.05 (Significant) 
p<.01 (Significant) 
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fact that the multivariate F was small, however, does lend credence to 
the probability that there is a wide range of sco.res ^within each 
grade level. 

Examination of the standard deviations and the range of test scores 
presented in Table Five, confirms the above view. 

It would be inappropriate to conclude this discussion without 
mentioning an additional supposition. When the correlations within a 
matrix are all between -.25 and +.25, the possibility exists that the 
tests may be unreliable. Since all reliabilities reported by the test 
publishers are of high magnitude, and, therefore, are reliable for 
their norm groups, it could be inferred that the- Jtegts are not as 
reliable for this target population. If, in fact, this is true, t^e 
lack of reliability may have been caused by the conditions relating to 
the testing procedure, or may be a direct function of the tests themselves. ^ 
Before any conclusion is drawn relating to reliability, it will first be 
necessary to examine the relationships between- the tests and an alteraate 
criterion, (i.e. GPA). 

Based on the results of the test of hypothesis 2, any attempt to 
conclusively identify the 'best* tests from this analysis would be 
misleading. It is interesting to note, however, that although the Hit/ 
Miss variable does not substantially differentiate between any particular 
test, hours completed does tend to correlate a bit more substantially 
with the three CGP basic skills subtests and the TASK Reading subtest. 

Since the individual relationships cited above were hardly over- 
whelming, it seemed interesting to attempt to determine the extent to 
which the predictor set of academic efficiency measures is related to 
the criterion, i.e., hours completed. The method of multivariate 
analysis used to examine this relationship was multiple correlation analysis. 

. ' 34 
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The results of this analysis indicate that the multiple 

J* 

correlation (R) is .293. This coefficient is the product-moiaent 

correlation of the best weighted linear con^osite of the predictors 

wita che criterion. A test of the statistical significance of R 

yielded an- F ratio of 7*455, which is sisnificant at the .0001 level. 

The square of the multiple correlation coefficient is equal to .086. 

This indicates that 8.6Z of the variance in number of hours ^completed 

is accounted for by the set of academic efficiency predictors. Since 

•2 

the highest single predictor (CGP reading) only accounted for 4% (.20 ) 
of the variance in hours con^leted, inclusion of miiltiple predictors 
is somewhat more useful. 

The standardized partial regression coefficients or Beta weights 
for each predictor 'variable are also supplied by the MULTR program. 
Despite the fact that they tend to be unreliable, they are sometimes 
useful because they show the relative independent contribution of each 
variable to the prediction of the criterion. The quantifying term 'some- 
times useful* has been placed ..in the above description because beta 
weights should not be interpreted unless they agree in sign with their 
corresponding ptedictor-criterion correlations. Since four beta weights 
in this analysis were negative, it was not appropriate to interpret them. 

\ 

Hypothesis 3. There will be significant relationship's between 

measures of persistence and selected biographic data. 

\ 

As a test of hypothesis 3, correlations were computed between the 
two measures of persistence and selected biographic data. These analyses 
utilized maximum sample sizes within the total sample. Descriptive data 
for the persistence variables is presented in Table Six (page 27) • 
Descriptive data for the biographic variables is presented in 
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Table Bight (page 32). The ihtercorrelations between the two sets of 
variables are presented in Table Nine (page 33). The sample size for 
each correlation is presented in parentheses beneath the correlation 
coefficient. 

Examination of Table Nine reveals that the strongest relationship 
exists between age^ and hours completed. This coefficient simply indicates 
that older students tend to have completed more hours. Since it is 
common knowledge that older students tend to be at a more advanced grade 
level than their yo'tinger school mates, this finding is hardly interesting. 
The other significant correlation coefficients are really not high enough 
to deserve discussion; Tentatively, however, they do suggest that older 
8tu4ents and students with higher high school averages have more of a 
tendency to be at or above grade level. In addition, the results suggest 
that students with higher high school averages have a slight tendency to 

have completed more hours. 

Interestingly, it is the non-significant correlations which are the 
most intriguing. The fact that sex is unrelated to persistence in this 
■ study contradicts previous research. Typically, it has be4n reported 
that within/CRfe^arget population, females perform differently, often 
better, than males. la addition, the lack of significant relationships 

between persistence variables and type of high schobl diploma, ethnicity-, 

\ * ■ ' 

and school type may very well contradict established points of view. 

Especially aa it relates to 'type of diploma and ethnicity, the attempt 

to describe characteristics- of persisters has provided evidence that 

certain characteristics may not be important factors in determining -"who 

makes it and who doesn't" and,, therefore, should not- be given strong 

weight in admissions decisions. 
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TABLE EIGHT 

TOTAL GROUP MEANS, STANDARD DEVIATIONS 
AND SAMPLE SIZES FOR SELECTED BIOGRAPHIC DATA 



Variable 


M6an , 


Sd 


N 


Sex 


1.57 


' .50 


962 


- < r 
Age- 


23.34 


6.48 


960 


High School 
\Code 


1.90 


-.30 


922 


High School 
Average 


76.68 


6.05 


.827 


Ethnicity (El) 


1.54 


.85 


962 


School Type 


1.83 


.38 


962 
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TABLE NINE 

CORRELATIONS BETWEEN PERSISTENCE AND 
SELECTED BIOGRAPHIC, VARIABLES 
WITH SAMPLE SIZES • 



Variable 
Sex 

Age 

High School 
Code 

High School 
'-^Average 

Ethnicity (El) 

School Type ' 
^(HEOP, EOP) 



Hoars Completed Hit/Miss 



.02 


.08 


(962) 


(962) 


.36** 


.13** 


(960) 


(960) 


..01 


- .03 


(962) 


(92.} 


.10* 


.17** 


(827) 


(827) 


.05 ■ 


.08 


'(962) 


(962) 


.01 


- .08 


(9620 


(962) 



p<..05(Significant) 
p<. 01 (Significant) 



P 
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Prealse B ; Academic efficiency is related to academic success. 

Hypothesis 4.\ There will ,be significant relationships between 
academic/ efficiency scores and loeasufes of 
yacademic succcsa. . ^ > 

Hypothesis 5.. There will be 'significant relationships between 
■Weeded biograpl^c data tad measures of 
academic success. 

A • ' ^ 

Because thd critetd^ contained within both of thel^above^-hypotheaes 
are identical, and because one of the analyses utilized to te/t both 
hypotheses contained bothi sets- of predictors, it ^ould be somewhat 
redundant t(^ treat the two\ hypotheses separately. For this reason, ^ 
both hypotheses will be considered jKnultaneously. 

The purpose of t/his aspect of the investigation was to ascertain 
which sifcgle variablk\or set- of variables best predicts academic success. 
Statistical piroeedutesv f rom the MAPS system were performed utilizing the 



e\ 



maximum sample sizes wichin the\total saii|>le. 

\.. 



' Descriptive data, for the academic efficiency variables has been 
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presented \ln Tableisix. descriptive data for selected l/iographic da^^ 
has been preseHtedl in TablA Eight. \Lescrip^ions of additional variables 
are presented in Table Ten Opage 35)- 



Correlations/ between th^ predictors and the criteria )^rp presented 



in Table Eleven (page 36). The sample sizes are the same for correlations 

between each predictor and the^ two criteria and therefore are presented 

to the tight of the coefficients)^ 

Examination of the academic Efficiency coefficients presented in 

.Table Eleven. indicates that all correlations, arfe significant and positive. 

Although not terribly high, comparatively they are higher than those found 

'In^the analysis which used hours iiomfileted as the criterion. The existence 

of a range of the correlations between .12 and .33 contributes some 

^ \ * 

evidence that these' tests are reliable y or the target population.^ 
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TABLE ten' 

DATA DESCRIPTION OF ADDITIONAL VARIABLES 



Variable 


Mean 


Sd 




GPA 


' 2.21 


.66 


962 


Ethnicity (E2)' 


.46 


.85 


• 962 


Ethnicity (E3) . 


- ..19 


.51 


962 


• 

GPAZ * 


.00 , ~* 


1.00 


962 



0 - 

> 




. 7 
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TABLE ELEVEN 

CORRELATIONS BETWEEN ACADEMIC EFFICIENCY, 
SELECTED BIOGRAPHIC, AND ACADEMIC SUCCESS VARIABLES 

WITH SAMPLE SIZES 



Vapame 


CPA 


, GPAZ 


N 


pA< 


, 32** 


.31** 


■852 


CGP Reading 


.28** 


. 29** 


919' 


Sentences 


. 33** 


. 33*.* 


919 


Math 


.2.7** 


,27** 


908 


* Year 2000 


.23** 


.24** 


916 


T'ASK Reading ^ 


. 32** 


. 33** 


940 


English , 


. 32** 


, 33** 


.941 


Math. 


.21** 


.23**' 


937 


SSHA DA , 


.18** 


.17** 


892 


WM 


.19** 


.18** 


892. 


TA 


.12** 


» , ,12** 


.892 


EA 


. 19** 


.18** 


892 


Sex 


;06 


.05 


962 


Age 


. 18**- 


.15** » 


960 


H.S. Code 


.06 


- .04 


922 


H.S. Av. 


.20** 


' .24** 


827 


Ethnicity (E1) 


. 22** 


.22** 


962 


IE2) 




- '.22** 


962 


(E3) 


.15** 


. 14** 


962.' 


School Type 


.19** 


.00 


962 



*p<.05 (Significant) 
**p<.01 (Significant) 

41 
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It is interesting to Yiote^ that in both analysea, the same general 
pattern is manifested. In both analyses, the SSHA, CGP Year 2000, aiid 
the TASK Math te^ts seem to account for the least amount of variance. 

In this particular analysis, those tests which ♦rpquire language ^ 
arts skills (i.e. CGP Sentences, TASK Reading and English, and CGP 
Reading) as well as. the XIAP account' for the most variance. However, 
since the size of the coefficients are so similar, it would be difficult 
to choose -among them. In addition, the magnitudes of the correlation 
coefficients are such that, on the basis of this analysis, identification 
of any one test as a valid predictor for use in selection procedures is 
not warranted. 

What would be warranted, hovever, would be the use of these tests 
for diagnostic and prescriptive purposes. Since it would be cumbersoBie 
for students to have to take more than one battery of tests, it would be 
useful to have some scientific basis for choosing among them. For this 
reason, a step-wise multiple regression analysis was performed using 
GPA as the dependent variable and the academic efficiency measures as 
the independent yariables. Rather than force any of the Independent 
variables into regression in a predetermined order, the optiori was chosen 
which allowed the program to freely select those variables, one at a time 
which would maximize the multiple correlation between the independent and 
dependent variables at each step. With this option, selection ceases 
when none of the remaining variables can independently make a significant 
contributiori to the prediction of the dependent variable. It wag 
anticipated that, based on the results of this analysis, it would be 
P98sible to determine which test was 'bcst|, because it would-"be selected 
first, which test was 'second best', because it would be selected^ 
second, and so^on. 



38 

* The results of the step-wise multiple regression analysis are 
presented in^ Table Twelve (page 39). The multiple correlation coefficient 
(R) is the multiple correlation of all' variables in the equation with 
GPA. The square of the multiple correlation (RSQ) indicates the* 
proportion of the variance in the criterion which is predictable from 
those predictors which are present in the equation at that point. The F 
value indicates the significance of the contribution of a given test to 
the prediction of GPA independei^t^of all other variables in the equation. 
By definition, all reported F values are significant. 

At first glaiice, it, would seem as if the results^ presented in Table 
Twelve only confuse the issue. Surprisingly, CGP Reading has dropped 
out of the picture accompanied by an appearance of two of the SSHA scales. 
On the basis of this analysis, CGP Sentences is clearly the 'best' test, 
followed by the CAP, and the TASK Reading. It would seem as if our 
search for one battery to be used for diagnosis and prescription, has 
ended with a batUry comprised of portions from each of the existing 
batteries. 

To end the discussion at this point, however, would be a mistake. 
The most important' finding which emerges from fhis analysis is no t^ that 
any particular test is 'best', but that, working together, the six tests 
account for approximately 21Z of the variance in the criteria, i.e. GPA. 
This represents a substantial increase over any single relationship and 
indicates 'that it is necessary to use a variety of measures with the 
target population. Unfortunately, 21Z of the variance is still not 
substantial enough to satisfy established validity criterion. 

Continuing on to hypothesis 5, which is to ascertain the relationships 

between selected biographic data and academic success criteria, i,t is 

necessary to re-examine Table Eleven. The results related to the biographic 
» 
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' TABLE TWELVE 
-RESULTS OF STEP-WISE MULTIPLE REGRESSION ANALYSIS 



Step 
Number 




Variable 


Multiple 

R 


r2 


Increase 
In r2 


F Value 


' 1 


CGP 


Sentences 


.332* 


.110 


.110 


119.041 


2 


CAP 




.424* 


.180 


.070' 


81.299 


3 


TASK 


Reading 


.441* 


.195 


.015 


17.. 491. 


4 


TASK 


English 


.4A7* 


.200 


•• 005 . : . 


6'. 564 


5 


SSHA 


DA 


.451* 


204 


.004 


4.311 


6 


SSHA 


WM 


.456* 


208 


.004 


4. 735 



Dependent Variable is GPA 
* P<.000'1 (Significant) 
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.variables are again not overwhelming but do indicate that older students, 
students with higher high school averages, and whites followed by "Others", 
tend to have higher GPA^s. The relationships between the variables and 
GPAZ are practically identical. However, the existence of a significant 
correlation between school type and GPA does indicate the presence of a 
school effect. Therefore, the coefficients between the variables and 
GPAZ are prob^Obly more meaningful for the total sample. 

It is interesting to notice that the lack of a relationship between 
sex, type of diploma and hours completed holds up for this analyais. 
Apparently, neither the sex of students nor the type of diplomas earned, 
are significant fuctbrs in predicting success in college. 

Considering the magnitude of both the academic efficiency coefficients 
and the biographic coefficients, and considering the results of the 
step-wise multiple regression analysis, it seemed useful to ♦ investigate 
the extent to which both sets of predictors, separately and in combination, 
are related to academic success. Multiple correlation analysis was ^ 
performed to examine these relationships. Because of the school effect 
found previously (reported in Table Eleven^ the criteria used for this 
analysis waa GPAZ. Predictor set one contains sex plus 5 biographic 
variables >?hich correlated significantly with GPA. These are: age, 
high school average, school type,. Ethnicity (E2) , and (E3). Since 
ethnicity variable El is simply the reverse of E2, only E2 (of the pair) 
was included in this analysis. Predictor set two contains the 12 
academic efficiency variables. 

The results of this analysis are presented in Table Thirteen 
(page 41). Since a number of beta weights in both sets of predictors 
did not agree in sign with their predictor-criterion correlations and 
therefore could not be interpreted, they were not included in the table 
of results. 

4 b 



TABLE THIRTEEN 

, RESULTS OF MULTIPLE CORRELATION ANALYSIS 
BETWEEN PREDICTOR SETS ^ND GPAZ 

Multiple 

R r2 F p less than 
. Predictor Set One .357 .127 23.203 .0001* 

(Biographic Variables) 

.Predictor Set Two ' .464 .216 21.749 .0001* 
(Academic Efficiency Variables) 

. Predictor Sets One And .505 .255 17.964 .0001* 
Two Combined 

Proportion Of Variance 

Uniquely Associated With Set One .040 
F Test of Significance 8.366 
p Value of F .0001* 

Uniquely Associated With Set Two .128 
F Test of Significance 13.519 
P Value of F 0001 

Jointly Associated With Both Sets .088 
* Signifidant 
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Upon examination of Table Thirteen, it is readily apparent that 
although the set of academic efficiency measures is the better predictor 
of CTAZ, the most effective prediction occurs when both sets of predictors 
are entered into the prediction equation. 

It would seem that the suggestion made by Stanley which was quoted 
in the Introduction to this paper has been supported by findings related 
to a test of hypotheses 4 and 5. "It would seem more sensible to 
predict the criterion for each applicant from all available predictors 
The naore disadvantaged a college applicant seems to be socioeconomically , , 
the more objective information one needs about him." 

Additional Hypotheses to Complete the Model 

Hypothesis 6. There will be zero correlations between measures 

of academic efficienrcy and selected biographic data. 

As a test of this hypotheses, intercorrelations-within the predictor 

set were examined. These correlations were available from the matrix of 

intercorrelations among all variables in the study. It is this matrix, 

computed with the total sample, which has been the basis for Tables Seven, 

If 

Nine and Eleven. 

Table Fourteen (page 43) presents the correlations between the 12 
academic efficiency measures and 8 biographic variables. Sample sizes 
are presented in parentheses beneath .the coefficients. 

The major purpose of this aspect of the investigation was to determine 
the degiree.to which the selected academic efficiency measures (test secures) 
are free- from bias. If the correlation coefficient between a particular 
academic efficiency variable and a given biographic variable was close 
to zero, this would indicate the lack of a relationship between the two 
variables. This in turn would suggest that the academic efficiency 
measure did not discriminate against or penalize any given group. 

4V 
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TABLE FOURTEEN 

INTERCORRELATIONS BETWEEN PREDICTOR SETS 
WITH SAMPLE SIZES 



Vd lauixs 


Sex 


Aae 


H.S. Code 


H.S. Av. 


E1 


E2 


E3 


School Type 


CAP 


- .10* 

(852) 


.04 

(851) 


- .07 

(814) 


.16** 

(732) 


..10* 
(852) 


- .10* 

(852) 


- .10* 

(852) 


.05 

(852) 


CGP Reading , 


- .08 

' (919) 


\04 
(919) 


- .10* 

(880) 


.25** 

(788) 


.30** 

(919) 


- .30** 

(919) 


- .22** 

(919) 


.03 

(919) 


Sentences 


.05 

(919) 


.06 
(919) 


- .05 

(880) 


.25** 

(788) 


. 32** 
(919) 


- .32** 

(919) 


- .25** 

(919) 


.07 

(919) 


Math 


- .15** 

(908) 


- .04 
(908) 


- .03 

(870) . 


.28** 

(779) 


.33** 

(908) 


- .33** 

(908) 


- .24** 

(908) 


.^04 
(908) 


Year 2000 


- .05 
(916) 


- .06 
(916) 


- .06 

(877) 


.25** 

■(786) 


.37** 

(916) 


- .37** 

(916) 


;28** 
(916) 


.01 

(916) 


TASK Reading 


- .09* 
(940) ' 


- .05 

(939) 


- .04 

(900) 


(806) 


.33** 

(940) ' 


- .33** 

(940) 


- .23** 

(940) 


.01 

(940) 


English 


.11* 

•1:941) 


- .02 

(940) 


.00 

(901) 


.28** 

(807) 


.28** 

(941) 


- .28** 

(941)- 


- .21** 

(941) 


.02 

(941) 


Math 


.19** 

(937) 


- .20* 

(936) 


.05 

(oy /) 


. 28** 

/ on/, \ 


.32*-< 

) 


- .32** 

W J ' ) 


- .21** 


.06- 


SSHA DA 


.29** 

(892) 


.25** 

(892) 


- .07 

(854) 


.09* 

(763) 


.00 
(892) 


- .00 

(892) 


- .00 

(892) 


.00 

(892) 


WM 


.21** 

(892) 


.14** 

(892) 


- .06 

(854) 


-.10* 

(763) 


.02 

(892) 


- .02 

(892) 


- .03 

(892) 


- .01 

(892) 


TA 


.09* 

(892) 


.18* 

(892) 


- .08- 
(854) 


.10*' 
(763) 


.13* 
(892) 


- .13** 
(892) 


- .10* 

(892) 


- .07 
(892) 


EA '-' 


.20** 

. (892) 


.28** 

(892) 


- .10 

(854) 


.11* 

(763) 


'.07 
(892) 


- .07 

(892) 


- .04 

(892) 


- .02 
(892) 



* p < .05 (Significant) 
p ^ .01 {(Significant) 
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The term 'group* > as used in this analysis has been defined by each 

biographic variable. For example, males and females are part of the 

sex grpup, younger to older students comprise the age group variable, etc. 

Examination of Table Fourteen indicates that school type is the only 
variable in the biographic set which does not correlate significantly with 
any test. HEOP and EOF students do not perform with any degree of 
difference pn these tests. 

For all practical purposes > the same can be said of <:High School Code 

> 

(type of diploma) since the relationships with all but one variable are 
non significant. The one significant correlation coefficient indicates, 
that students with high school equivalency rather than 'high school 
averages pn their records tend to do slightly better on CGP Reading. 
Even though this relationship is significant, the coefficient is extremely 
low. Considered in combination with the 11 other zero order coefficients, 
it is suggested that little weight be placed on the significant relation- 
ship , and that the pattern of correlations be interpreted as suggesting 
that the academic efficiency measures do not discriminate between students 
on the basis of type of diploma. 

No single pattern of correlations exists between the test scores 
and sex. In fact> the pattern seems to be somewhat irregular containing 
both positive and negative, significant and non significant correlations. 
For example, even though both correlations are significant, the CGP Math 
test favors males and the TASK Math test favqrs females. Since the content 
of both tests are similar, these results are difficult to explain. It 
would seem that the most useful point which could be made regarding these 
relationships is that all correlations, whether positive or negative, are 
rather low. In addition, it should be noted that these findings, because 
of the presence of significant correlations, contradicts the findings 
related to persistence «nd academic success- 

4;) 



The correlations between the test scores and age are also 
Intriguing. Although older students seem to have better study habits » 
they do not appear to have higher achievement test or CAP scores. Again 
this might be explained by the erratic pattern of the Seniors. Since- • 
they are older, ,they would have had to score higher than the other^' 
students In order for high correlations to result. 

Interpretation of the remaining relationships Is relatively clear 
cut. The relationships between the test scores and high school average 
are all positive and significant. Although the magnitude of the correla 
tlons Is not large » the correlations still suggest that students with 
higher high school averages tend to perform better on the academic 
efficiency measures. As a result these measures do, by definition^ 
discriminate between students. 

Except for SSHA DA, WM and EA, all tests tend to differentiate 

between ethnic groups. .The corr^elations within El indicate that whites 

perform better, followed by "Others". The coding in E2 is simply the 

reverse of El and, thexfifore, indicates the same results as El except „^ 

s 

in opposite directions. The coding in E3 was established to verify the 
second place taken by the "Other" group. By coding the "Other" group 
so that it was at one extreme, while at the same time coding ^the whites 
so that they were at the other extreme it was possible to observe a 
slight decrease in the negative correlations within E3. If the "Other" 
group had not been in second place, this slight decrease in the size of 
the correlations v/ould not have occurred. 

iwen though the order of the groups within the ethnicity variable 
is of some interest, it is not the most important result in this analysis 
Of greater significance is the fact that the magnitude of several 
individual coefficients within *the ethnicity set are equal to or greater 
than ainy other individual coefficients thus far reported* Those tests 
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which seemed, on the basis of other analyses to ^best* predict 
persistence and GPA, seem on the basis of this analysis ^o contain a 
degree of bias. Although the SSHA, for the most part, does not fit 
Into the latter category ,^ neither does It fit Into the f orm^r^ It may 
not contain a great deal of bias, but It also does not function as a 



. usef^ul predictor 
A^ain, 



it^^mji^t^be concluded, that the academic efficiency 
measures Mo not meet the criterion of valid prediction. 

Although not specifically a part of this analysis, two additional 
tables have been presented in this section. The purpose of this is to 
supply the readervwith all sections of the matrix of intercorrelations 
among all variablesNin the study. 

Table Fifteen (page 47) presents the intercorrelations between the 

8 variables within predictor set one. I.e. fleeted biographic data. 

\ • ' 

The I within the table refers to an indefinite argument due to the 

attempt to correlate a continuous variable with a single integer. Since 

lib range is present in a single integer, no correlation is possible. 

This result is a function of coding all students with high school 

averages were coded 2 for high school code. 

Table Sixteen (page 48) presents the intercorrelations between the 

12 variables within predictor set two, i.e. the academic efficiency tests. 
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TABLE FIFTEEN 












INTERCORRELATIONS WITHIN PREDICTOR' SET ONE' 










WITH SAMPLE SIZES 




• 




Variable 


Sex Age 


H.S. Code H.S. Av. , 


El^ 


E2 


E3 ; 


School 
Type 


Sex 


1.00 .10* 
(960) 


.10* .20** - 
(922) (827) 


■ .14** 
(962) 


.14** 
(962) 


.06 

(962) 


- .00 
. (962) 


Age 


1.00 


_\38** - .09* 
(920) (825) 


■ .05 
(960) 


.05 
(960) 


- .02 
(960) 


- .09* 

(960) 


H.S. Code 




1.00 I 


■ .05 
(922) 


.05 

(922) 


.06 
(922) 


- -.03 

(922) 


H.S. Av." 




1.00 


.12** 
(827) .. 


- .12** i 
(827)^ / 


- .05 
(827) 


-. .04 
(827) 








1.00 


-1.00 

(96,2) 


- .75** 
(962) 


.01 
(962) 


E2 








1.00 


v75** 
(962) 


- .01 

"(962) 


E3 




4 






1.00 


- .01 - 
(962) 


School Type 












1.00 




* p<,05 (Significant) 
** p<.01 (Significant) 
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Hypothesis ?• There wlli.bc significant relationships between . 
aeasuras 'of acadenlc success and- measures 
* of persistence* 

• \ 

The purpose of this aspect of -the investigation was to ascertain 

V 

whether persisters succeed according to predetermined standaifds of 

' ' ' ' 

success, i.e. grade point average. Correlations within the criterion 

set weie pertinent to a test of hypothesis 7 and were available from the 
matrix of intercorrelationa among all variables in the study. As 
stated previously, this matrix was cojaputed using the total sample. 

. Intercorrelationa among the criterion variables are prese^te* in 
Table Seventeen (page 50) • , ^ ^ 

Examination of Jable Seventeen indicates that all correlations are 
positive and significant. The strongest relationship exists between 
the academic success measures GPA and GPAZ. This can be explained by 
the apparent fact that standardizing GPA by school does not ostensibly 
change the rank of CPA's within the total sample. 

The docfficient between the persistence measures, Hit/Miss and 
houi/s con^leted indicates that those students who have completed more 
hours, i.e. upperclassmen, tend to be hits. ^ Even though a major factor 
in the construct Hit/Miss is hours completed, the fact that the 
coefficient is not higher should have been anticipated since many 
menbers of the target population (especially Freshmen) are encouraged 
by program personnel to take fewer courses than the nuiAer typically 
recoianended for members of a non-dlsadvantaged group. 

The results of this analysis between the persistence measures and 
the academic success measures indicate that students who are Hits 
(i.e. those who are at or above grade level) and -^the upperclassmen 
(i.e. students who have completed more hours) tend to have'higher GPA*s. 
The latter relationship is interesting because it^ supports 



TABLE SEVENTEEN 



fNTEaCORRELATlONS WITHIN THE CRITERION SET 



Hours 
Completed 

Hit/Miss 
GPA 
GPAZ 



WITH SAMPLE SIZES 
Hours" 



1.00 



4 « 



p Less than .01 (Significant) 



Hit/Miss 


GPA 


GPAZ- 


.40** 

(962). 


..*29** 

(962) 


. 29** 
(962).- 


1.00 


.24** 
(96b 


.27** 
(962) 




1.00 


.97** 
(962) 






1.00 



( 
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hypothesis 7 which hypothesizes 'that persistence is related to success 
in college. ' There is a tendency for persisters to academically 
demonstrate success .in college according to those standards on which 
colleges nomally base- merit* 

H)rpothe8i8 8* Grade point average means -will be higher for 
each succeeding gfade level. 

The purpose of this aspect of the investigation was no answer the 

question, "Do students become Tuore academically successful With time 

spent in cSllege?"/ It was anticipated that the findings related to 

\ ' • , ' ^ 

this question would contribute to an understanding o^ the effect, 

college has upon academically disadvantaged sutdents* 

^ince it was undesirable to separate GPA from t>ie vector of 

measur^s-which described academic performance, GPA was included as a 

dependent variable in the one factor, four l^vel multivariate analysis 

of variance* 'As described previously under the description of the 

methods used to test hypothesis 1, this analysis tested the significance 

of differences among the four grade level groups on 12 academic 

-efficiency measures and CPA* This analysis utilized all subjects with 
complete data on all 13 variables. 

Table Three (page 22) presents descriptive statistics from the 
multivariate analysis of variance (MANOVA). Multivariate and univariate 
analysis of variance results are presented in Table Four (page 23). 

In order to be consistent, GPA was also included in the report of 
the MAPS data description which presented descriptive statisticis for all 
13 variables. Table Five (page 24) presents these results. It should 

,be noted that the means presented in Tables Three and Five represent 
base rates of learner behavior for each grade level. 
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Examination of Table Four indicates that the multivariate F of 

♦ 

3^43 with 39 and 2278 degrees of freedom is significant at the .0001 
level. Inspection of the univariate F's reveals that of the 11 
significant variables, GPA is the most significant on an individual basis. 

The results of this analysis, however, only provide a first step in 
the test of hypothesis 8. T^e second step involves an examination of the • 
neans reported in Tables Three and Five in order to ascertain whether 
a hierarchical arrangement exists. 

When this examination is made, it can be seen that with the exception 
of the means for Seniors, grade point average means are higher for each 
succeeding grade level. It is apparent that for some reason, the mean 
for Seniors is the same as the mean for Juniors (MAPS results, Table Five), 
or less than the mean for Juniors (MANOVA results. Table Three). The 
difference in the statistic for the same variable reflects the difference 
in the sample sizes used in tabulations generated by each program. 

It Is worthwhile to speculate for a moment on -the effect that these 
findings may have on some of the other results of this Rtudy. First, 
the size of a mu^t^variate F of 3.43, even though significant, is 
indisputably small. The erratic pattern of the Seniors on 9 pf the' 12 
academic efficiency variables and GPA could, in part, account for the 
limited size of the F. In addition, the correlations between . these 
variables and hours completed are of small magnitude. Since Seniors \^ 
have by definition completed the most hours, their erratic pattern could^^ 
suppress, the correlations between* hours completed and the 13 academic 
performance laeasures. 

It would be possible to test these possibilities by eliminating 
Seniors and reanalyzing the data using Freshmen, Sophomores and Juniors. 
Even if this were done, however, and it was found that Senior's scores 
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had suppressed the results, we would still be unable to account for 
our new findings. Therefore, it is much more appropriate to attempt 
to explain the erratic pattern of Seniors. One possibility might be 
that the attitude of the Seniors toward the tests and testing procedures 
was less positive than the attitude of any other group. Because they 
were relatively near to graduation, perhaps they felt more confident 
that the test results would not effect them and therefore did not 

pursue excellence. " 

Another possibility might be related to the provision of supportive 
services. Supportive services refers to program provision for counseling 
and educational assistance or remediation. -The latter is supplied 
throug.h tutorial services and developmental or remedial courses in the 
areas of basic skills and college content. These services are offered 
to all program participants during the school year and for pre-Freshraen 
during the summer preceeding their Freshmen year. 

It is known that Seniors entered college at a time when Educational 
Opportunity Programs were in their infancy and therefore supportive 
services were minimal. If lack of supportive services makes a difference, 
this could explain the pattern of ' means and the low correlations. 
Fortunately, the existence of two groups within the , total "sample consisting 
of those schools with strong supportive services and those with minimal 
supportive services makes it possible to conduct a preliminary test of 
this supposition by comparing the correlations between hours completed 
and the 13 academic performance measures for the two groups. Even though 
all Seniors entered college when supportive services were limited, it 
is possible that those who attended schools where a greater emphasis ^ 
was placed on the provision of those services took advantage of this 
opportunity to some degree. If this were the case, correlation coefficients 
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for the group with strong supportive Services should be higher. 

The two correlation matrices were computed using the RMATRIX 
program from the MAPS system. Maximum sample sizes within each group 
were utilized. Table Eighteen (page 55) presents the means, standard 
deviations and samples sizes for the two groups on the 13 variables. 

Table Nineteen (page 56) presents the results from the correlation 
analysis. It should be noted that with an N of 150, the coefficient 
must be .159 or higher to be significant at the .05 level and .208 
or higher to be significant at the .01 level. For an N of 125, 
•05 - .174, .01 * .228. 

Examination of Table Nineteen indicates that the coefficients 
between hours cdmpleted and the 12 academic efficiency measures are 
still fairly small. In addition, the pattern is similar to that 
obtained with the total sample. Several differences are noteworthy. 
The first observation to be made is the large difference in sample 
size between the two groups. The fact that so many students are from 
one type of program served to suppress some of the correlations between 
variables for the other type of program when the total (combined) group 
was used as the sample fox analysis. When the groups are separated, 
it is possible to observe that the TASK Reading subtest and the CGP 
Year 2000 test correlate more strongly with hours completed for the 
strong supportive group than they did within the total sanq>le. In 
addition, it seems as if the SSHA has no relationship wil:h hours 
completed for the strong supportive group. Without examining a pattern 
of grade level means for each group, however, this is difficult to 
explain. In any case, since all the coefficient's related to the 
academic efficiency measures continue to be small, it must be concluded 
that these measures of academic efficiency do not relate substantially 



55 



TABLE EIGHTEEN 
DATA DESCRIPTION FOR TWO GROUPS 

Strong Supportive Services and Minimal Supportive, Services 



Strong Supportive Services Minimal Supportive Services 



Variable 


Mean 


Sd 


N 


Mean 


Sd 


N 


CAP 


101 


.59 


12 


89 


136 


103. 


23 


12.20 


■ 716 


CAP Reading 


- 48 


.13 


10.02 


140 


48.83 


9.71 


779 


Sentences 


46 


.14 


9 


/. C 


140 


47. 


86 


8.44 


779 


Math 


49 


.30 


8 


.41 


137 


50. 


25 


8.23 


771 


Year 2000 


■ 46 


19 


11 


36 


. 140 


46 


57 


11. ir 


776 


TASK Reading 


51 


90 


13 


.06 

> 


163 


52 


23 


12.93 


777 


English 


48 


.70 




83 


164 


49. 


31" 


10.17 


777 


Math 


27 


58 


9 


04 


163 


26 


08 


9.06 


774 


SSHA DA 


23 


.63 


10 


31 


136 


'23 


66 


9.83 


756 


- WM 


25 


96 


9 


53 


136 


25 


73 


9.81 


756 


TA 


'24 


80 


9 


20 


136 


23 


J.0 


8.99 


756 


EA 


25 


91 


8 


25 


136 


25 


33 


6.49 


756 


GPA 


1 


n A 




67 


168 


2. 


25 


.64 

• 


794 



GU 



56 

TABLE NINETEEN 

CORRELATIONS BETWEEN HOURS COMPLETED AND ACADEMIC PERFORMANCE 
MEASURES FOR TWO GROUPS : STRONG SUPPORTIVE SERVICES VRS 
MINIMAL SUPPORTIVE SERVICES WITH SAMPLE SIZES 



Variable Hours Completed 

Stronq Mipimal . 

Supportive Services Supportive Services 

CAP -0^ -^3** 

(136) (716) 

CGP Reading .. .19* -20** 

(140) (779) 



Sentences 



.16* .18** 

(140) (779) 



Math .13 .19** 

(137) (771) 

Year 2000 .21* ^ .09* 

(140) ', (776) 

TASK Reading .32** .14** 

(163) (777) 

English .18* .11* 

(164) (777) 

Math .08 .08 

(163) ■ (774) 

SSHA DA - .02 .10* 

(U6) (756) 

WM - .02 .14** 

(136) (756) 

TA -07 .02 

(136^ (756) 

EA .00 .13** 

(136) (756) 

GPA .^9** .25** 

(168) (794) 

* p < .05 (Significant) 
** p <.01 (Significant) 
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enough with hours completed to provide support for this explanation* 
In addition, this analysis has once again indicated that regardless of 
whether they are considered with the total sample or with subgroups wi,thlu 
the total sample 9 relationships between the 12 tests and hours completed 
^ are not strong enough to identify specific measures on which perslsters 

4 

excel. For this reason, they would not individually be useful indicators 
of student potential* 

The two remaining coefficients in Table Nineteen are striking. The 

, coefficient between GPA and hours completed for the strong supportive 
group is almost double the coefficient for the other group. This shows 
that there is a stronger relationship between the variables' loiT the 
strong supportive group than for the minimal supportive group indicating 
that as students at the strong supportive schools progress through college, 
their CPAs tend to improve. There is then a success factor related to 
persistence for the strong supportive group which is ii^ot accounted for 
by the battery of tests. 

The major differences between the two types of programs are: the 
services available at strong supportive schools include extensive 
provision of tutoring, -counseling, and developmental or basic skills 
courses, as well as pre-Freshman programs; the services available at the 
minimal supportive schools include tutoring and counseling only. It has ' 
been stated by program personnel at. the minimal supportive schools that 
they feel their supportive services are not at the level needed to make 
the programs as effective as they could be. 

Without more extensive data analysis and a larger sample size from 
the strong supportive schools, it is perhaps premature to draw conclusions 

from this digressive investigation. The comparative results of the 
correlations between GPA and hours completed, however, would seem to 
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indicate that the degree of provision of supportive services might 
explain the presence of a college success factor for persisters at 
strong supportive schools. This in turn could indicate that these 
services are beneficial to the target population and therefore 
should be encouraged* 

Hypothesis. 9* There will be no significant differences^ 

between academic efficiency scores of mid-year 
Freshmen and nev admittants. 

The purpose of this aspect of the analysis was to ascertain 
whether mid-year Freshmen are representative of entering Freshmen* 
This hypothesis was added to the study because the testing, which, was 
originally scheduled' for Fall semester, could not take place until 
early Spring* If the tests are to be used with beginning Freshmen 
as an aid in diagnosis and prescription , it would seem useful to 
describe the base rate of actual beginning Freshmen performance. 

A one factor, two level multivariate analyses of variance (MANOVA) 
was used to test this hypothesis* Since, the NYBMUL program requires that 
all subjects have a complete vector of scores, only those students in 
each group who had scores on all 12 academic efficiency measures were 
included in the analysis* 

Table Twenty (page 59) presents the means and s.tandard deviations 
for the two groups on the 12 academic efficiency measures* The results 
of the multivariate analysis of variance are presented in Table Twenty-One 
(page 60)* 

Examination of Table Twenty-One indicates that the multivariate F is 
Bmall but significant* When we examine the- univariate F^s in Table 
Twenty-One to a«certain which individual variables are the most significant, 
we can observe that only one variable is significant* It is, therefore, 
this variable, TASK English, which accounts for the difference between the 

63 
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TABLE TWENTY _ 

MEANS AND STANDARD DEVIATIONS FOR 12 ACADEMIC EFFICIENCY MEASURES 
FOR MID-YEAR FRESHMEN AND NEW ADMITTANTS 

Variable ' Statistic Mid-Year Freshmen New Admittants 

' ■ • " N = 255 N = 82 

CAP Mean 101.28 - 102.46 '~ 

Sd li-10 11-70 

/ CGP Reading Mean 46.10 47.78 

Sd 10.13 11.07 

Sentences Mean 45.63- ^ 45.40 

Sd 8.70 9.06 

Math Mean 48.42 48.44 

Sd 8.08 8.26 

Year 2000 Mean 44.39 44.62 

• ScJ ^ 10.71 11.81 

TASK Reading Mean 49.58 t fa .22 

- Sd 12.53 03.94 

English Mean 48.07 , ^ 45-.23 

Sd 10.03 10.. 93 

Math Mean 25.04 23.21 

Sd . 8.49 8.87 

SSHA DA Mean 22.84 24.43 

Sd 9.34 11.31 



WM Mean 24.35 24.91 

Sd 9.89 9.55 

TA- Mean 23.42 25.73 

Sd 9.66 9.57 

EA Mean 24.70 / 25.95 

Sd 8.50 • 9.43 
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.two groups.' - The only conclusion that can be drawn from this analysis is 
that the groups do differ, but only on one variable. If we. are establish- 
,lng base rates of .Freshmen behavior, we can perhaps receive 'some direction 
• by exaasiug the Table of Means^ (Table Twenty page 59). This examiiiation 
reveals that the largest difference between the groups' is on the TASK 
English where the difference is approximately 3 points. All other 
differences are wi^ a two point range and; it will be noted, do not 
all favor the same group; Therefore, it would appe.ar that a base rate 
could be established which is approximate but still within the range of 
the means presented in the table. Since the^eans. for both groups are 
all below those of the Sophomores and Juniors, the pattern of means in 
this analysis and previous analyses are consistent. ^ 



Adjunct Investigation 

Major Field of Study: 

The purpose of tj^B aspect of the investigation was to: add to the 
knowledge base regarding the target population. This was accomplished 
by jJresAiting descriptive statistics for seven broad areas of study. 
These descriptive statistics are presented in Appendix C, Part II. 
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VI. CONCLUSIONS • " ' ' 

» • 

*^The purpose of this study was to substantiate the use of selected 
cognitive and* affective 'measures for effecti>>e identification of degree 
and level of academic disadvantagement of Higher Education Opportunity 
^Program students in New York State. The substantiation process was 
predicated on relevancy, appropriateness, validity, and lack of bias 
of each measure. 

The measures which were included in this -study were selected from a 
larger group^of instruments by a panel of experts. Since these experts 
deemed^ the selecte'd measures both relevant to and appropriate for the 
target population, the present study concentrated upon an investigation ^ 
of the two remaining qualif ications\^ vali/and^ unbiased prediction of 
academic success. The assumptions underlying satisfaction of these 
criteria supposed that upperclassmen would receive higher ^^ade point ^ . 
avera^ and higher scores on the selected insl:ruments than would • , 
lowerclassmen^A In addition, it was assumed th^it aU those students £.rom ^ 
the total .sample, who r^eceived higher grade point averages, would receive 
higher scores on the measure^ in question. 

- Two premises, therefore, provided a framework for the design of this 
investigation: ' ^ -^^^^ ~ 

o 

A. Academic efficiency is related to persistence; and 

r 

B. Academic efficiency is related to academic success. 

A summary of the major results accompanied by conclusions based on 
these results are presented \}elow. ^ • , 

1. in general, upperclassmen perform more efficj^ently than lower- 
classmen on the measures selected for inclusion in this study (hypothesis 1) 
it can be concluded, therefore, that premise A can be accepted. 
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2. Positive but weak relationships exist between* individual 
acadeonic 4fkclency measures and persistence measures. Although the 
' relationship becorads strpnger when- academic .efficiency" taeasures. are 
combined'. t6 'itiYestigate the relationship with hours completed, it is 

• 4till weak (hyt)othesir 1) , Therefo.re, pn.the basis of^ these analyses, 
•it is not possible to identify wi^li' any degree of validity, those 

measures oa which persistersv excel. • - . ^ 

, > , > * * 

.3. Rtel,atioriship<-between pers-istence and sex, type of high school 
dlplom^', and. ethnicity- axe -non significant (hypothesis 3). In view of . 
these, results', it Is suggested, that, these characteristics be given, little 
weight in' admissions decisions. ^ • * 

A. In -terms of premisfe By positive "but -weak relationships exist : . 
- between individual academic efficiency measures and ackd^emic success. ^ 
Although the relationship, is « strengthened when thi academic efficiency 
measures are-conSidered^ as a set,', the .gtrength.of the relationship is still 
not sufficient to me^t established validity criteria.. The most valid 
relationship between predictors '^d criteria appears to kist when scores* - 

• from the selected instrumeiits' and. biographic d^ta are considered^as a 

set (hypotheses 4 and- 5) . If the criteria* i-.^e.> GPA. is itself a-valid 

. • '** 

"one, these flTudings lead. to. the coHclus^on t{iat a variety of information- 

is needed .before admissions decisions can be mad>.f or a disadvantaged 

• stjudent. ' 

5. There is a tendency for the .achievement measures to discriminate 

among members of the target population on certain biographic ^ ariables 
such as high school average and ethnicity. 'There is less- oT a tendency 
■ for the affective. measures to^^do so (hypothesis 6). The fact that these ' ' 
tests show a relationship between higher sthopl .averages and improved 
performance on the tests, is both expected and desirable. Tlie fact.' that 

/ 
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these testa sho» a relationship betveen higher test scores and 
ethnicity is neither expected nor desired. That these measures do 
relate to ethnicity suggests possible limitations regarding their use 
in Educational Opportunity Programs. 

6. In general, students who are at or above grade level and 
students who have completed more hours, i.e. upperclassmen , tend to have 
higher grade point averages (hypotheses 7 'and 8). In effect, this says , 
that academic success is related to persistence. This finding is 
valuable because It compliments those results which ^e directly 
related to premises A and B. In'addition, it represents a logical 
extension of the two premised; an extension which is needed to complete 
the model. 

The results of the present investigatioa suggest restrictions on the 
use of the measures in question. The magnitude of the validity coeffi- 
cients in combination with findings related to bias, place stipulations 
on. the use of these measures for making admissions decisions. Rather 
than relying upon one battery of tests, admissions^ decisions must be 
predicated upon an examination of a variety of types of information. 
These might Include biographic data, cognitive and affective test scores, 
and personal interviews. 

Regardless of the problems associated with admissipp« decisions, 
programmatic decisions would be facilitated by the effective identification 
of learner needs. The measures included in this study, were selected 
because their content focused on ar^eas of potential need. Those measures 
which, are concerned with affective characteristics such as interests, 
self-concept, and study habits and attitudes would certainly be useful 
for counselors.' Thos3 measures whiqh concentrate on academic skill areas 
could proVldeVa basis for the provision of educational assistance 
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and remediation, "in addition to their usefulness in these contexts, the 
validity coefficient of the combined measures is- not unreasonable when 
considered in this context. Furthermore, since the selected measures 
were written by. exp.erts in thi field, it is highly probable that attempts 
to improve upon them would be unfruitful. Perhaps some energy should be 
directed toward the .development of alternative testing techniques 
especially as they relate to the admissions process. In terms of program 
planning, however, it is recommended that program personnel select from 
among the measures investigated in this study, utilizl/ng both cognitive - 
and affective measures so that sound bases for progra^ii planning for each 
individual student will be available. j 

. Although the findings of this study do not all6w strong re^co^jenda£i9ns 

of a specific battery of tests, a Serendipitous finding is of<^'value to / 

f I 

personnel involved in Educational Opportunity Progr.ams. #iis finding 

I I 

suggested tjiat the grade point averages of students whoT^ttend programs , 

i- I 

which provide strong supportive services tend to improve a^s these studenps 

I 1 / 

progress through college. This result lends cre4ence to tKe supposition 
that provision of supportive services is a key viriable in the maximization 
of student potential. It is for this reason that\ the recommendations , 
stressed a cogent utilization of instrumentation iirected toward diagnosis 
and prescription. Any or all of the measures investigated in this study 
would „be useful/ in this context. • / 
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1. College Academic Rerformance Biographical Inventory (CAP) 
Greensboro, N.C. : Prediction Press, 1969. 

Now available from: /Tonrr^N 
Institute for Behavioral Research in Creativity (IBRICJ 

1A17 South 11th East 

Salt Lake City, Utah 8A106 ' 

The College Academic Performance Biographical Inventory Is a 
composite instrument comprised of 200 multiple-choice items taken 
from the 300 item Alpha Biographical Inventory. The instrument 
requires that an individual describe himself and his background 
and includes a variety of questions about childhood activities, 
academic, experiences , attitudes, interests, and' self-description 
-evaluations. Since the items are written at a vocabulary level 
which is appropriate for high school use, HEOP students would 
experience little difficulty with reading. CAP is untimed and 
most students should be able to complete it in approximately 
one hour. 

Several methods are available for scoring CAP. In this study, 
the instrument will be scored with the Academic Performance Key. 
This key was developed by a process which selects and weighs various 
combinations of items until a maximum correlation with the appro- 
priate criterion (e.g. GPA) has been reached. The use of ' this key 
_ yierds one score. The Academic Performance Score, which will be 

utilized in the analysis. 

Test-retest reliabilities for the Academic Performance Score 
are .86 for males and .88 for females.' Use of an original technique 
for estimating reliability coefficients which provides a- measure of 
item consistency produced a coefficient of .88. This method has been 
described in the. Manual for Alpha (1968) which is available . 
from IBRIC. 
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Survey of Study Habits and Attitudes (SSHA) Form C. 
New York, N.Y. : The Psychological Corp., 1967* 

The Survey of Study Habits and Attitudes (SSHA) is comprised 
of 100 items which measure an individual's methods of study, 
motivation for studying, and certain attitudes toward scholastic 
activit-i-es. The SSHA is useful as an aid in understanding students 
with academic difficulties and also provides a basis for helping 
these students improve their study habits and attitudes* 

The SSHA consists of numbered statements to which a student 
may respond in one of five ways: Rarely (0-15Z of the time). 
Sometimes (16-35Z) , Frequently (36-65Z) , Generally (66-85Z) or 
Almost Always (86-100%). Estimated completion time for this 
untined instrument Is 20 to 35 Minutes. 

Four basic subscaletf consisting of 25 items each are con- 
tained within the instrument. The Delay Avoidance subscale and the 
Work Methods subscale provide a measure of study habits. Study 
attitude is measured by the Teacher ^Approval subscale and the 
Education Acceptance sabscale. 

Seven scores may be derived. The four subscales provide one 
score each. The scores on the first two subscales can b^ combined 
to provide a score for Study Habits. The scores on the last two 
subscales can be combined to provide a score for Study Attitudes. 
In addition, a total score labeled Study Orientation may be derived 
by combining the four subscale scores. 

Internal consistency and test-retest reliability data are 
available from the four subscales. The internal consistency 

estimates of reliability using the Kudey-Richardson Formula 8, 

'J 

ranged from .87 to .89. Test-rekest reliabilities for a four week 
and a fourteen week period ranged from ,.83 to .93. 



Sfnford Test of Acadealc Skills (TASK) Level II-A 
New York, N.Y. : Harcourt Brace Jovaaovich, Inc., 1972 

The Stanford Test of Academic Skills (TASK) Level II-A is 

designed to measure the basic skills of reading, English and 

mathematics at the junior college level. The battery consists 

4 

of three tests, one for each of the skill areas. All items are 
of the multiple-choice variety, some with four options, some with 
fivel The items range from quite easy to fairly difficult. Each 
of the tests, yields a single score. The working time for each of 
the three tests Is 40 minutes resulting in a total time of 
two hours. . ^ ^ 

The three tests are described ^as follows: 

Reading 

The 78 item reading test contains two parts. Part A of this 
test measures Reading Comprehension and Part B measures Vocabulary. 
In Part A, (items 1-42), the student is instructed to read a 
paragraph and then answer the questions which follow it. The student 
may re-read the paragraph in answering the questions. Items 43-51 
of Reading Part A require the student to read a paragraph in which 
several words are missing. The student must then choose from among 
4 options the word or words that should be inserted in the paragraph 
to have it read correctly. Technically this may be thought of as a 
modified cloze technique. Fart A tests the student's ability to 
comprehend what is explicit in the material, to judge what is implied 
and to draw inferences with reference to other situations. 

In Part B (items 52-78). the Vocabulary section, the student is 
given a word and instructed to match it with one of the five choices 
which is most closely related to the given word. For example, if the 



presented word were "trjtangle", the student would be expected to 
match it with '^geometry" rather than "economics", "botany", 
"prejudice", or "reasoning", the other four options. 
English 

The English .test measures the student's knowledge and effective 
use of the English language. The 69 item test contains five parts.. 
Part A (items 1-15) deals with learning skills such as dictioiiary use, 
reference sources, and the nature and structure of language. 

In Part B (items 16-36) the student is to determine for each 
underlined passage in a short narrative whether there is an error in 
capitalization, grammar, punctuation, or if there is no error present. 
Part C (items 37-51) in a spelling test. The types of spelling errors 
presented are based primarily on phonics and word building skills. 
Part D (items 52-57) tests English expression. The student is 
presented with items containing four compound or complex sentences 
from which he chooses the one which expresses the idea best'. Part E 
(items 58-69) pres-ents a series of four-sentence paragraphs in which 
the logical sequence of the sentiences in the paragraph has been 
jumbled. The student is to reorder the sentences so that the 
paragraph presents the idea properly. 

Mathematics 

This Jtest consisting of 48 items is designed to measure general 
mathematical competence; it emphasizes arithmetical and numerical 
concepts, computation, and applications with some minor emphasis on 
algebra, geometry, and measurement. The content covered by the test 
is that which is considered to be an integral part of general 
education and' to be basic preparation for more advanced study in 
mathematics. The test includes a*raode6t emphasis on "new mathematics" 



Typically, the student will have been exposed to most, if not all, 
of the content of this test by the end of the seventh or 
eighth grade. 

Because of the recent development of this test, reliability 
infotMtion for college students is not yet available from the 
publisher. However, the manual presents split-half (Spearman 
Brown, r^j.) and internal consistency (Kuder Richardson, '^kR2o^ 
subtest reliabilities based on 12th grade students. Reliability 
coefficients for each subtest are as follows: Reading r^^. - .95, 

-^KE^o - .94; ^"^''^^ "^11 " 'kR2(, - .94; " '^^^ 

'^KR2o - .94. 

k^Four out of eight sections of the: - 
Comparative Guidance and Placement Program (CGP) of the 
College Entrance Examination Board, 1972. ^ 

The Comparative Guidance and Placement Program (CGP) is a 
comprehensive battery of six tests and two inventories designed to 
gather a wide range of information about a student's abilities, 
interests,. and needs. In this study, the four tests which measure 
basic skills will be utilized. These are Reading (25 minutes). 
Sentences (25 minutes) , Mathematics (AO minutes) , and Year 2000 
(10 minutes). The latter section provides a measure of a student's 
ability to follow directions. Administration time for the four 
tests totals two hours. 

The Reading test consists of 8 brief passages (50-250 words) 
followed by 35 related questions that measure four crucial skills: 
1) comprehension of the main idea; 2) comprehension of specific 
details; 3) ability to make inferences; and A) ability to extract 
the meaning of vocabulary from context. The subject matter in the 



passages is varied and is directed toward a variety of interests 
and reading preferences. The level of difficulty of the test 
facilitates identification of students who need remedial work. ^ 
In addition, the test differentiates among levels of skill through-, 
out most of the range of reading ability. 

The test, entitled Sentences, measures a student's mastery of 
standard written English. The section, which contains 40 questions, 
presents a series of sentences, many .of which contain the types of 
errors frequently made in granmar, usage, choice of words, idiom, 
capitalization, and punctuation. The student is asked to recognize 
faulty written English where it occurs. Research has shown that 
performance on -similar ques^tions is closely related to essay scores 
based on several independent readings. Thus, a student who scores 
high on this CGP test is likely to be one who can write correctly 
and effectively. 

There are three mathematics tests - Matheipatics C, Mathematics 

D, and Mathematics E. Students take only ond of these tests. 

Mathematics C consists of computation and problems in applied 

/ 

arithmetic. Students will take Test C if they have not studied 
algebra or if they have studied algebra for less than one year. 
Test D, consisting of computation and elementary. algebra problems, 
is for students who have studied algebra for one year. Test E, 
an algebra test, is for people who have studied algebra for more 
than a year. Npte that some questions appear ^both Tests C and 
D, other questions in both Tests D and E. 
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Belov are descriptions of each of the tests: 
Mathenutlcs Test C ^ 

This test consists of two sections containing 35 and 25 items 

\ 

respectively. In thfe first section, the student will be requited . 
to add,^ Subtract, multiply, and divide with whole numbers, fractions, 
decimals, and percents. In the second section, he will 'be expected 
to apply arithmetic skills to the solution of practical problems. 
Mathematics Test D " ^ ^ ^ 

This terft consists of two sections containing 35 items each. 
In the first section,* as in Test C, the student will be required 
to add, subtract, multiply, and divide with whole numbers, fractions, 
decimals, and percents. The second section measures the knowledge 
and skills normally acquired in a first year high "^school algebra course. 

Mathematics Test E ^ " \. 

This test consists of two sections Containing 35 items each. 
The first section is like the second section in Test D. The second 
section tests additional algebraic topics that are usually covered 
in a second year high school algebra course. " ^ 

Year 2000 - 
This test consists of a calendar for the first six mbriths of 
the year 2000 and a set of 20 directions ^for finding certain dates 
on the calendar. Each direction serves as a test question, and the 
s.tudent marks the date he chooses on the special calendar printed- 
directly on the answer sheet. 



\ 

\ 
\ 

The directions become increasingly complex as the student 
prodecds ti:irough the test; eventually he is required to use 

u 

several rules in order to select a date. 

' Test-rct«8t reliability was supplied from a draft edition of 
the CGP technical manual. The reliability coefficients for the 

^ \ : 

subtests are as, follows: Reading .88, Sentences .83, Math C 



total .91, MathV total .89, Math E total .89, and Year 2000 .73. 
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1. Start testing 1/2 hour after schedule tise - therefore schedule 
111 hour earlier tjian you wish to begin. ^ ^ 



2* Explain purpose for testing: 



3* Simultaneously (with #2) have proctors pass out test #1 and pencils^ 

>i • ' 

4. Give instructions for test #1 (CAP) ' ^ ' 

L 

a) explain that the test is (i.e. bip inventory, achievement test, etc.). 

b) have stud^nHs fill out bio data on answer sheet (MAJOR TO BE LISTED'^^ 
ON ANS<^ER SHEET) . ' 

c) explain how answer sheet works \ . ^ . 

.J • 

d) tell them how much time they will have 

e) ask for questions 

f) stress that it is important to answer every question 

g) have them begin ' . 

5. When everyone has finished have: , 

* 

-1/2 of the prpctors collect the^ test and answer sheet 
-1/2 of the proctors pass out, the 2nd test 
^ -if only a few students have not finished stop anyway and have them 
finish after test 2. is pver. ^ 
6; Give instructions for test #2 (TASK) as in #4 above. In addition* 

a) follow the times indicated in the manual for eAch part 

b) be sure to tell students how much time they will have -prior ^ 
to coB^^ting each part * ^ - . . 

c) , asfcJ^hem to try their best i 
7. Dismisfe them for luncfi. 

-have proctors at every exit to collect tests, answer sheets and pencils. 

> * ♦ ■ 

-teir them when to return - allow 15 extra minutes (i.e. tell them to 
come back 15 minutes before you actually want them) . 



B-2 

8. Pass out test #3 (CGP) , answer sheets and pencils. 

9. Give inBtructions for test #5 (as in #4) 

a) Be sure the students understand where on the answer sheet to 

1 
I 

record their answers for a given part^ 

b) He will only use 4 of the 8 tests. Make sure no one is putting 
answers in the wrong place* j 

10. Proceed as in #5 above. j 

11. Give instructions for test #4 (SSHA) as in #4 above. 

12. Let ea,ch student leave when he is finished - handing his test, 
answer sheet and pencil to a proctor. ^ 

13. As a student leaves, thank him for participating. 

For testing - You will need: 
~4 tests 

-4 sets of answer sheets 
-sharpened .pencils 
-a stop watch 
—proctors - 4 is a good number 

0 
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/ APPENDIX C 

/ MAJOR FIELDS OF STUDY 

PART I: CLASSIFICATION 
PART II: DATA DESCRIPTION 
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